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ABSTRACT 



EVALUATION OF EAST TENNESSEE'S CHILD HEALTH AND DEVELOPMENT PROJECT 

Trudy W. Banta, University of Tennessee, Knoxvil^ 
• Linda Higginbothan, Appalachia 'Educational Laboratory, Charleston West Vi^'ginia 
ifc^riel Levin, University of Tennessee, Knoxville 
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\ The Child Health and Development Project (CHDP) , a home-based early 
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intervention program operated in six East Tennessee counties, provides well-«fhild 
clinics .^y^evelopmental evaluation, and individualized early child^jood education 
for disadvantaged children, and training in p'arenting skills for their parents.. 
Ny^ The University of Tennessee's Bureau of Edacati^>nal Research evaluated CHIJP - - 
services through a six-^iaonth treatment-comparison .group study, jecord revievs 
for clients^ served' 18 months, assessment of public opinion in c^unti^s served,; 
and measures of staff mora - and effectiveness oF project xnanagement, Anal^sies • 
ot covariance performed on data derived, from pre- and pos^t--treatment measures' 

demonstrated that six mon|;hs of the C3iDP intervention produced significant * » 

^ " ' 

differences favoring the treatment group in IQ, cosmunic^tioij skjllls, and diet. 

Parents reported that the program increased their understanding "of child 

development aifd enabled them to teach and manage tfie behavior of their childi^n 

more effectively. ' , ' 

I 



/ 



■ ERJC 



EVALUATION OF EAST TENNESSEE'S * 
CHILD. HEALTH AND DEVELOPMENT PROJECT 



Trudy W» Bahta 
^ Asscciate Professor 

Bureau of Educational Research and 
Unl^versity of Tennessee 
Knoxville 



Service 



Linda Higglnbotham 



Muriel Levin 



PROJECT DESCRIPTION 



The Child H^lth and Development Project (CHDP) is a home-based early 
intervention program whicli promotes parenting skills and attempts to facilitate 
the physical, social, and intellectual development of disadvantaged children* 
from birth through six years of age. Tlie CHDP is a program of the Tennessee 
Department of Public Health, and was initiated in 1973 with 'a five-year grant 
from the Appalachian Regional Commission (ARC), As ARC funds were being phased 
out in 1977 additional funding for the Project wa^i obtained frc^\ Title XX of 
the Social Sefcurity Act, and by 1978 this constituted the sdle funding source. 

The theoretical Basg for thq CftDP evolved from research performed during 
'the late 1960s by Dr. Susan Gray at George Peabody College, for* Teachers in 
Nashville, Tennessee. Gray^s work at the Demonstratidn and Research Center, 
for Early Edixcation (DARCEE) revealed that working with the parent (s) in the 
home can have a significant impact on each child and on the family system. 
Accordingly^ the philosophy of the CHDP is that the parent is the child^s first 
and most important teache^ in the first few years of lire; therefore, working 
through the parents is the nK>st effective means ' of ^developing a sustained 
change in the child environment. 

# The clients served by the CHDP are children from birth through' six years 
of age who are in need of child development services and reside in one of six 
rural counties in East Tenxiessee: Claiborne, Cocke, Grainger, Monroe, Morgan, 
or Scott. Within each county served by a Project team, children and their 
families- must be declared eligible for the Project on the basis of Title XX 
guidelines, i.e., the family must be receiving SSI or AFDC aid or have a lim:'.i.ed 
incoae and demonstrated need for the program. "Need" may be based on one or 
more of these conditions: low infant hematocrit, existence of chronic parasitus, 
mental illness, poor housing truancy in older children, etc. During 1978 the 
C^P served an average of 825 families and 1344 children each month. 

The CHDP utilizes a i^ltidisciplinary team approach including at. least 
one nurse, social worker, home educator, and secretary at each Project site. 
Each CHDP team works cooperatively to provide for fts clients (1) well-child 
care clinics, including vision and hearing screening and nutrition counseling; 
(2) developmental evaluation (using the Denver Developmental Scri^^ning Tejst),; 
X3) individualized early education for each Project child during home vis^its; 
(4) needed referrals to appropriate social' service agencies; and (5) parent 
education. * ^ * 



Weil'-child care is provided during weekly clinics according to Child Health 
Standards of Tennessee , T^nessee Department of Public Health (1976). Clinic 
services include physical asses^itients, immunizations, TB skin tests, parasite 
screening, and health counseling* The P^roject nutritionist attends at least 
one clinic at each team site a month an^ provides counseling at that time as 
well as during home visits. ' Group experiences are provided for children and 
parents* A psychologist consults with each team and may accompany team members 
on home visits. ^ • ' 

Each team member, upon emplovnrient by the CHDP, undergoes three weeks of 
intensive jSre-service training provided by the Training il'eam-of the Division 
of Maternal and "Child Health, Tennessee Departfient of Public Health, Na'shvflle^ 
This training is a modification of the Training Program for Hone Intervention 
which was developed in 1974 by DARCEE at Peabod> College in- Nashville. In 
addition, each nurse receives one month of traii^ing provided by the local 
health department.! Continuous in-service training on a variety of relevant 
topicf.. including a one hour presentation by the Project nutritionist, is also 
provided on a bi-monthly basis. 

\ Seven Project teams working in six counties are supervised by a team 
-centrally located in Knoxville. The supervisory team is composed of a director, 
administrator, nutritionist, nursing supervisor, social services supervisor, ^ 
two early education supervisors, and secretaries. 

The 'primary goal of the CHDP is to promote the physical,. §ocial, and 
intellectual health of client children through a program *of comprehejisive 
child health and development services and .p^irent education. This goal is 
implemented through seven principal objectives: 

1. To provide well-child care for each Pro'ject child (according to Chil d 
Health Standards'of Tennessee , Tennessee Department of Public Heal^JfJ , 

^ 2. To prev^t minor developmental delays from becoming later handicaps 
througn early detection and intervention. 

3. To provide an in-home early education program , for each Project child. 

J. 

(Note that objectives 1-3^ are chiid-^oriented. Objectives 4-7 are 
parent-oriented.) ^ 

^. To enhance the parentis role as the child's first and most important 
teacher through promoting' a healthy parent-child interaction. 

5. To promote preventive health care thtou^ parent education. 

6. To decrease the social isolation of Project families. 

7. To serve as an advocate on behalf of Project families with 
individuals, groups, and organizations in the community. 

V 

THE EVALUATION PLAN 

In 1976 personnel from the Bureau of Educational Research and Service (BERS) 
at the University of Tennessee, Knoxville were asked to undertake a program 



evaluation of the CiiDP. Working closely with the CHDP supervisory team, BERS 
staff developed a set of specific, measurable objectives for each of the seven 
general Project objectives. These objectives were of two types: process and 
terminal. Process objectives were related to. the delivery of services, i.e., 
was ^t he 'S4irv ice ^actually pertormedt in the manner or to the extent specified? 
Te^^minai objectives described outcomes which might be expected if related process 
objectives W4^re achieved. ^ . . 

Due to funding limitations, the evaluation contract did not go into effect 
\intii September 1, 1977, and then only for a period of nine months. In order 
to obtain evaluative data for each objective, the f ollowing^^rocedures were 
utilized: ' * ^ , 

1) A review was conliucted of the Project records of 20 children (five 
children. at each of four Project sites) who had been CHDP clients for 
approximately iS months. Parents of tiiildren at each site were 
interviewed individually by the ream secretary using the "Parent 
Questionnaire" designed by the evaluators.^ 

2) A treatment-comparison group study was conducted with 37 children 
between, the ages of two and four years who were new to the CHDP. 
Twenty children were* identified for the comparison group* in Monroe 
County, where Project services were just beinfi introduced at the tine 
this phase of i;he evaluation began. Seventeen children for the 
treatment group were identified- in five counties in which the CHDP 

as well established. Demogra^^hic characteristics for families in 
treatment and comparison counties were quite similar: all were white 
' and poor, and lived in a rui;^l or small-town environment in Appalachia. 

^ Children in the treatment \group received six«months of project services. 
Children in the romparisdn group received no services during the aame 
six months period, but were promised CHDP serviced at the end of the 
evaluation. Both' groups were j^iven the Alpern-Boll Developmental 
Profile (Mpern and Boll, 1972) before and after the six months 
treatment period, and the parent of each child gave a* 24-hour diet 
recall for the cUild and participated in teaching the child a contrived 
task which was observed and assessed by the evaiuators. Following 
the six months of CHDP services the Parent Q;iestionnaire was administered 
orally to parents of children in the treatmenK group, and the Project ] 
records for these children were reviewed and evaluated. 

3) In order to evaluate the management component of the C^DPr 

a) an instrument entitled "Opinionaire for Team Members" was administered 
to team members at each Project site, and 

^ J 

b) a questionnaire entitled "Community Survey for the Child Health and 
Development Prpject'* was mailed to a stratified random sample of 
citizens in counties served by the Project. 

REVIEW OF PROJECT RECORDS / 
Healtlf^ Records 

( 

The evaiuators reviewed the Project records of (1) 26 children who had been 
CHDP ciients for approximately IS raonths (CHDP staff specified 18 months as the 
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. ulnimua time required fc -Project services to produce real changes in clients, 
and their families,) and (2> the 17 treatment group subjects who had received 
Project services for six months, 

J ' The fol^-owing statements suraaarize aajor findings from the review af Project 
Health Recordst ^ • . ' ^ ^ 

% 

. 95% of aLl Health Records reviewed (19 of 20 eighteen-month Records, and 

16 of 17 six-month Reco'rds) showed, that the Project children had received 
♦ the required number of detailed nursins visits* 

, all children served for IS months had had all required inmxuniaations; 
only 47% of those served for 6 months had received .all iianiariizations 
required at their respective 4ges.« • 

100% of the Project, children who needed vitamins and iron supplements 
had received them. * ■ . ' ' 

# 78% of the Health Records reviewed (75% of the IS-month Recoxds and 82% • 
of the a-month Records) showed that the client's hematocrit had\been 
raised to the recommended level of 34-35. 

* ' .86% of the children (95% in CHi)P IS months and 7^6% in CUDP 6 mo»ths) had 
received parasite screening. 'All'' children who needed treatitjent for 
elimirtating parasitic infection received treatment. 

. 100% of the- children in the Project 18 months had received a skin test • 
for tuberculosis, as h^d 82% of those in the Project for 6 months, llo 
child needed treatment for ti-be. c-jlosisv \ ? * 

' . 76% of the children (60% of these serl^ed It? months, "94% of those served 
6 month^i) had received appropriate vision s :reening while in the Project • 

. 85% of the children irv the Project for IS months and 65% i?i uhcse served 
for 6 months had had their hearing tested according to Child Health 
Standards. ^ " 

. all children who had problems with vision/hearing, ears, nose, or 
throat that the CHDP nurse could not treat were referred to a physician 
^ or other appropriate source. 

. 85% of the IS-month Health Records, and 71% of the 6-month Records were 
considt^red by the evaluat5rs to be adequately maintained. 

^' 

Developmental Screening 

As part of the effort to diagnose develapmental delays each CHDP home s. 
visitor is required .to administer the Denver Developmental Screening Test to 
each of her/his clients once every ^ix mortths. Nineteerf (95%) of the 20 
children whose records were reviewed after 18 months of services had had the 
Denver at six-month iri'tervals^ All of the 17 treatment subjects had received 
the Denver during their six ironths of services. 



Unfortunately, the Denver provides only a p^ross measure of developinent : 
not* one of the 2o' children who were subjects of the lS--month record review was 
found to have developmental deficiencies as measured by the Denver, .In the 
group ot 17 treatment children/ only two registered delays on the Denver: 
one was gr.ossly tetap*Ied and the other had m^^rked speech problems. In both 
cases' the records avowed that hone .visitors were making concentrated efforts 
to encourage the parents to work with the child in the areas of developmental 

^^^^y* Service Plan-Home Visit For*s 

Each of the 37 records reviewed' contained one or more Service Plans 
outlining an educational plan for the subject based on her/his developrneulial 
needs anS t?ie parent's teaching/nianaging skills. Each set of records contained 
several Home Visit Forms which included plans for introducing age-appropriate 
learning activities during the visit with child and parent. 

Sixty percent of the 18-j^th set of records and 76 percent of the 6-;rtjonth 
set contained narrative evidence, provided by the home visitor, that parents' 
nuinagenent and teaching skills had^improved during the period of CHDP services. 
However, when the earliest home-vis i|:or assessment of 'Behavior Management' 
skills on the "Educational Needs iVssessment'^ (ENA) for the IS-month subjects 
was compared with the latest rating on the ''Assessment of Parenting and .Educa- 
tional Needs'* (APEN), improvement had occurrecj. in only 42 percent of the cases. 
A t test for related measures showed no significant difference between pre- 
and post-intervention means on the 'Teaching Style' soale of the ENA and APEN, 
Ther^ was some evidence that instrument unreliability rather Chan lack of 
Project impact was responsible for the small number, of significant increases 
which occurred' when ratlnp,s on these instruments were compared. 

' Parent Oj^inion 

The evaluators designed a ^'Parent Questionnaire" to sample parent opinion 
ccncerning progress toward meeting CHDP goals, ^The quejst ionnaif e was administered 
orally to 19 of the 20 parents whose children wp.re subjects of the IS-^month 
record review, and to the parents of the six-ifibnth treatment subjects- 

Overall, parent reaction to the in-home education program provided by .the' 
CHDP was quite favorable. All except one of the parents- whose child'i^ records 
^ere reviewed said the Project had helped ■ them ' give their child 'more \things 
to play with' and learn from'* More than -80 percent of the parents of both 18- 
month and 6-month treatment groups felt they could 'handle the teaching' of 
their child 'better than before the Project started^. All parents saici they 
were ^lad to he in the Project ^ that it had given them all they had ^expected 

from it, and that they would recommend the Project to other parents.^ 

t 

When 'asked what they liked most about the Project approximately 70 percent 
of the patents mentioned the hone visits,' with the toys and learning activities 
brought by the home visitor to increase ^learning opportunities for their child, 
as the greatest benefit of Project participation. Parent comments revealed 
their recognition that the Project intervention had enhanced their own teaching 
skills, . 

Most parents were enjoying their child more as a result of Project 
intervention; this effect apparently Jjicreased with exposure to Project services 
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because parents associated with Che Project for 18 ©onths expressed substantially 
^aore favorable attitudes thad did thoa^ in the Project for only 6 tnonths. 

An* increase in parent confidence in the ability to teach their own child 
was 'indicated in three responses: ^ 

a) 895; of ^'e^lS-month parents, and 71S of fehe 6-month parents fait the 
Project had helped them *cake better care of' their child, 

\ . - 

b) 95% of the 18-month parents and 762 of thfe 6-nonth group said the 
Project had given them ^ stronger feeling' that -they^ere their 
child's 'first and most important teacher'^ and 

• 

c) almost all parents questioned believed the Project had helped them 
give their thild 'more things to play with and learn from'. 

Parents felt they were receiving information about child development; 

a) 34 of 36 parent respondents expressed the opinion that the CHDP had 
helped them 'know more about' what their child 'should be learning at * 
different ages', and 

b) 33 of 36 parent respondents said the Project had helped them 'leafn 
aboat the way children learn and grow'. 

It was difficult to tell from reading Home Visit Forms if the home visitor 
was actually promoting the parent's teaching ability or just working with the 
child during the visits* A Parent Questionnaire response made it quite evident ■ 
that the home visitor was Jiaving 'an* impact on both parent and child, i.e,, all 
parents said the home visitor explained learning"' activities in such a^\way that 
parents could do the activities with thcj^^^f^ld after the visitoi; had gone. 

• 

Parents appeared to be, more involved in the education of their own children 
as a result of the CHDP intervention,^ Approximately 85 percent of all parents 
interviewed said they 'spent more time now' teaching their child than they spent 
prior to the -inteiyention. Parejits of children se^ed by the CHDP for 18 months 
said they Jjpent, an average of two hours each day teaching their. child; parents 
of the 6-roonths treatment groijp reportedly spent an average of one hour* 

Parent promotion of the development of language usage skills seemed to 
increase 'as the length of intervention increased: 84 percent of the 18-*nKDnth 
.parents and 47 percent of the 6-month parents said they were talking more to 
^their* child now than they were prior to the CHDP intervention. 

In general, parents bciieved in the imp^ortance of CHDP services: 100 
ptSrcent of the parents interviewed felt ^he Project W9uld*help their child 'do 
better* in school. ^ • 

• According to Project records, apjSroximataly 80 percent of the 37 families 

involved in the record reviews had problems which warranted referral to other 
agencies for additional serviq:es not provided by the CHDP^ With^one fxception, 
every family that needed help was referred to an appropriate agency; and all 
but two <both in the 6-monch treatment group) had been to the agency at the 
time their records were ri^viewed. The CHDP has established an outstanding record 
of making appropriate referrals and assisting ^client families to take advantage 
of thetu., 
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•SIX-MONTH TREAT^^ENT-,CO^ffARISOM GRQUP STUDY 

Design of the Comparative Study 

• 

Ir an evaluation the most convincing evidence of a program's tif fuctiveness 
is derived fxom a design in which a group of subjects receiving treatment is 
compared on a number of measures acquired both before and after treatmenc/'with 
a comparisoiv group that receiveji no treatnent during the same period of time. 
Statistical prqc:edures may be used to control for the effects of factors other 
^ than the treatment which may ve an effect on the performance of the treafuent 
and oomparison groups » thus s::"' ^ngthing the conclusion that any difference 
between performance of the two groups at "the end of the study is due to the 
treatment and not to other factors. 



Selection of Subjects ' 

An attempt was made to implement a treatment-comparison group study as 
part ofj the CHOP evaluation. The BERS evalqation staff established a goal 
of obtaining 25 children for a treatment group and 26 children for the 
comparison group. The treatment subjects were to be newly recruited. Project-^ 
eligible males and females between the- ages of 2 and 4 years in counties whefe ^ 
the CHDP had been in operation for at least' 18 months. These counties included 
Grainger, *Cocke» Morgan, Scott, and Claiborne. Children for the comparison group 
ware to' be newiy recruited, Project^eligible males and females between the 
ages of 2 and 4 years in Monroe County, an area in which the CHDP was just * 
beginning a.t the time this phase of the evaluation got underway. Children 
for the comparison group were recruited in Monroe County in order, to minimizje 
the possibility that their families would come in contact with families being 
served by the Project and thus acquire "contaminating" knowledge of Project 
services. . ^ ^ 



Since age and sex are such important determinants of early childhood 
development , an attempt was made to balance' the treatment and comparison groups 
with respect to these two variables. This I'imitation and others irpfibsed by 
circumstances prevented the evaluators from reaching their initial goal of 
obtaining 25 children for both treatment and comparison groups. At the 
conclusion of the study the treatment group consisted cf 17 children, 13 boys 
and 4 girls; and the comparison group contained 20 children, 14 boys and 
6 girls. Neither treatment nor comparison group contained clients who were 
considered *'high risk," but in every other way the candidates for the 
evaluation weie obtained by random selection from the clients available in 
the 2- to 4-year-old range. 



Measurement Instruments T 
- " Pre-lreatment measures were obtained on treatment and comparison subjects 
during early 1978. Treatment grcup children then received six months' of CHDP 
services while comparison subjects had no services. Post-treatment measures 
were obtained during the fall of 1978. 
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In oxd^v to provide ni6Adures of 'cha broadest possible range of CHOP 
•ervlces, the follovlns data were collected fro« both treattaent and ccwnparison 
subjects: * ' , 

1) scores on the five scales 'of the Aipcrn-BoirDevelopxnental 
Profile i.e.» Physical Age, Seif-httip Age,, Social Age, Academic' 
Age^ and Consounication Age. 

2) a diet history score (based on two 24-hour recalls spaced' 
approxioately one week apart) • ^ 

3) a score on ^'Observation of Teaching Task** andean accompanying - 
parent interview (designed to assess parenting skills)* 

4) scores' on a '^Parent Questionnaire" (for parents of treatiaent 
! group only).. * ^ 

Sy'ryvdew'of Project records for the treatment groupsjA-order to 
' determine the extent to which Project bbjt;ctives had been attained. 



' Tlie Developmental Profile was developed in 1972 by Gerald D. Alpern and 
Thomas J. Boll to assess the developmental level of children between the ages 
of birth and prt-adolestcence (approximately 12 years of age) in five areas: 
Physical Age, Self^-Help Age, Social Age, Academic Age (which is easily converted 
to IQ), and Communication Age. The Developmental Profile Manual (1972) provides 
the follow iing description of the scales. • ^ / 

* The inventory provides an individual profile which ^ 

depicts a child's developmental-age level functioning 
. ; by classifying his particular skills a^ording to age 
norms in five areas. brief ly^described below: 

' Ph y^i^^l Age - This scale measures the child's 

physical developmenX by determining 
<^ / his abilities with tasks requiring 

iiirge and sn^ll muscle^ coordination, 

* ' { strength, stamina, flexibility, and 

sequential control skills. 

Se^f-Help Age This scale measures children s 

abilities to cope independently with 
the environment and measures the 
^ ^ child's skills with such socialization 

tasks as eating, dressing, and working. 
This scale evaluates the degree to 
which children are capabX*^ of responsibly - 
caring for themselves and pthers. 

^ Social A ^e - This scale ^measures the child's 

interpersonal relationship abilities. 
The child's emotional needs for people, 
as well as his manner in relating to 
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friends, relatives, and variD\is adults 
exemplify the bVI^IIs vhich toeasute the ' 
^ child's functioning in the social 

' * situation. 

Acadetnjc Age -This itscale measures the child *s 

\^ ^ intellectual abilities by evaluating, 

^ at pre-school levels, the development 

\ Q ' ' . of skills prerequisite to scholastic 

functioning and, art the school age 
Itivcls, actual academic achievements. a 

Cojnmunication Age - Th^s scale measures the child's 
r • ' expressive, and .receptive coxaauniifation 

skills with both verbal and non-^verbal 
. ' languages. The child *s use and under-^ 

. Standing of spoken, -written^ and gesture 

languages are evaluated by* this scale (p* 1). 

Each scale of the Profile contains questions designed to measure developiBcnt 
at half-year intervals from birth to 3h years, and^ at yearly intervals from 4 to 
12. -The scales' yi<ld^ scores in monthjp of development, in many instances the 
examiner is. able to teVC^the . child ' s ability to "perform a certain developmental 
task at the time of the examination^ For other items ^ that are not readily 
observable (ability to play an a friend's home without being watched constantly, 
for example) the examiner must a*ik the parent to respond to questions about the 
child's behavior. The Developmental Profile scales have face validity, but 
only the Academic Scale has been the subject of correlational studies designed 
to establish validity. Concurrent validity has been established by virtue 
of a significant correlation of ,84 oT>tained between the Binet Mental Age and 
Academic Age. The Manual supports a claim for high inter--rater and test'-retest 
reliability on the basis of a study in which there was no difference between 
two sets of Profile scores obtained by two raters two or three Hays apart. 

The diet history' score for. the evaluation was obtained by *tsking the' 
parent, .to recall what the child had eaten withift the past 24 hQurs* Tvo^ of A 
these 24-hour recalls were obtained fpr each Child in the treatment, and ^ompari^on 
groups so that one score might serve as a check on the other. The two scores 
thus obtaia4*d Were averaged, and the mean scoVe was^used in the analysis. 

^ ' . ■ ^- 

Th>- ''Observation of Teaching Task" (OTT) and accompanyfng parent interview 
were designed by the Project staff iyi consultation with Dr. Donald Dickenson, 
a Professor in the training program for school psychologists within the Depart- 
ra^jnt of Educational Psychelogy at the University of Tennessee, Knoxville. 
Several instruments which purport to measure parent-child interaction or 
parenting skills were reviewed, and spme of the best items froiS each, o^ these 
scaleS)Were adapted for use in the OTT ind inCervieSr,. The instrument which 
was relied upon most heavily in this process was that presently beXag-^sed 
by CHOP staff to- assess patenting skills, the "Assessment of Parenting and 
Educational Needs/' The OTT and interview werq field tested by tHte BERS 
evaluation staff and those members of the CHDP staff who WDuld later assist 
in the testing of treatment and comparison subjects. Staff from Prqject 
sites brought in chiMren who had already been served by the CHDP to |.artici- 
pate^in Che field trial. As a resuljt of pre-^testing, some items were deleted, 
And others -underwent substantial changes in wording. Inter— observer agreement 
during the field trial was acceptable. * yi . - 
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Administration or Ir.s trutnents , 

1*? obtain scores onHhe OTT the . examiner presented the parent ^a sei of 
simple' materials, and requested that the mother teach the child an irg<?- 
appropriate activity using the iterials. For instance* the pare^t.pf a 2 
year old was given a handful of balloons and buttons and was instructed to 
ask tht-f . child • to sort the materials in two separate piles, one pile of 
bailc-^ns, and one pile of blittons. Parents of children between the ages of 
2^2 'ind 3^* were given pictures of objects commonly found in a kitchen, and 
objects comiponly found Tn a bathroom, and were asked to instruct the child 
in the tank of sorting the objects accord ii-;^ to the rooiii in which they • 
belonged. Parents of children who were nearis^ 4 years of age were given two 
sets of colored cardboard circles. Each set contained four circles the s^^'ze ^ 
of a nickel and four circles the size of a quarter. The parent was instructed 
to ask the chi^d to sort the circles by size and color. Then the parent, was 
rated by trained observers on items within each of four scales on the OTT: 
'Provision for Child's Emotional Needs', 'Behavior Management', tJse of 
Language', a ad 'Teaching Style' . Finally, one of the observers asked the 
parent another* set of items in each of the following categories : ' Behavior 
M:inagement,\, 'Use of Language', '^Teaching Style' ♦ an<!^ 'Organiziltion df Child's 
Environment', The total score for each scale was obtained by suinmi,ng scores 
, obtained for Dhat scale xjia thti OTT *and via the interview. 

Scores on che Developmental Profile, the diet history, and the Observation 
of Teaching Task/ Interview were obtained ^for each treatment and each comparison 
subject f!rior to the Initiation "of treatment for the experimental group, and 
again six months later. Thus two sets of scores were available for each 
.subject- The children were fest^id in their homes, with one or both parents 
present , and the data for each subject were ' obtained by one of three Evalu- 
ation Te^iiKs . Each Evaluation Team was composetk-^gf one member of the CKDP 
staff TLvA one membf'r of the BERS evaluation staff .^-x..^ 

One r^err.ber of the Evaluation Team read the items and recorded responses 
on the Dt've ]^opraentai Profile, while the second member of the te^m* worked with 
the child- on thost.' items which requir^^d the child to demonstratjt an at^ility^. 
Therefore, only one set of scores for the Developmental Profile was obtaiaed 
for each, subject ^ , . ^' 

During administration of the OTT both members^ of the Evaluation Team 
rated the parent on all items . Oie mQ;mber of the team theii read the interview 
itoms to the parent ^ bat both members recorded scores. Thus two scores on 
thti OTT/ interview were obtained for each child in the evaluation study. 

Ont.^ dit't nistOi.y score was obtained at the time of the Evaluation Team's 
visit, and a second 24-hour recall was obtained by a local CHDP staff member 
apprQxlmate ly one week before or one week after the visit made by the Evaluation 
Team. All diet history forms were scored by. the CHDP nutrition specialist. 

The^lJ?j^ent Questionnaire was designed by the BERS evaluation ^taff in 
order to gather feedback on the Project from parents^ Each question was 
directly related to a CHDP objective for wh^ch no other good measurt: of 
ari'ompi 1 ^>hmcnt was available. During the lust home visit made by the Evalu-- 
ation '^■^nm to the home of each' child in the ^ treatment group, the member of 
the W valuation ' staf f read the Parent Questionnaire to the parent and 
recorv, the responses. The instrument was introduced near the end of the 
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home. visit, after all^other measures had been obtained, and the CHDP menjber 
of the E.aluatlon Team was asked to leave tlie home while the parent was 
que^tipned. The ev^^.luators hoped that the parent would be more honest if 
no member of the CHDP staff was present during the interview • 

Finally, the file containing Pixjject records for each experimental child 
was reviewed by the BERS staff member of the Evaluation Team, using tho same 
review form which had been used in June 1978 for the IS-nibnth record reviews. 
Slip,htiy different criteria for assessing the adequacv of the entries on the 
record were applied , however^ since the CHDP intervention had been underway 
only six months at the time of the reviewer — " 

During the home visits by the Evaluation Team the following information 
about each treatment and comparison subject was obtained from the parent for 
use in subsequent data analyses : 
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hone county 

age 

sex 

familv income 

participant in the V/IC prograiri 

nunbcr of older siblings 

number of younger siblings 

father's educational level 

mother's L^ducational level 

father present in the home or absent 

number of older children in the household 

number of younger' children'^in the household 

birth order of the child 
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Description of Treatment and Comparison Groups 

The tijeatment group for the CIIDP evaluation consisted of 17 individuals , 
13 males and 4 females. The comparison group contained 20 individuals, 14 
males and 6 females. The two groups were quite siipiiar||in chronological age 
at the time of pre-testing: 34.75 months for the treatment group and 34.90 
months for the comparison [^roup . 

Family income was recorded in seven cntep,ories for the purposes of this 
stud^/: s 

■ V. , * ■ N 

(1) Under $4,000 (3) $6 ,3G6-<;7 , 788 (5) $9 , 273-$10, ?56 (7) Over $12,240 

(2) $4,001-36,305 (A) $7, 7S9-.$9, 272 (6) $10.757-$12,239 ' 
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The niqan income for families -of treatment group children wagiust slightly 
highei^ than that' for comparison *group families: £.8 for treatment group aryi 1.6 
for th^ coanarison group* '(This means' that j^st responses for both groups were 
in Category 1:, 'Undei $4,000'v) Table ! presents the percentage of'.treatment 
and compai^ison parents reportln^^ income in each category, ^ 

Table 1 Percentage of Treatment and Comparison Group Parents Report inf^ 
Income in each of Seven Income Categories 



Category 


1 


2 


3 


4 


5 


6 


i 

H 


Treatment 
Comparison 


66^ 
55 


10 


12 
20 


• \ 

5 


5 


0 
0 


' 0 

0 



Comparison group children . came from slightly largejr families, than did 
children in the treatment group. The mean number of older children in treatment 
group families was .81, The mean number of older siblings for comparison group , 
children was 1.10. The number of younger siblings for treatment group children' 
was .50, thg. nuT!iber of younger siblings- for compi^rison group- children was .62. 
Since some children In the treatment and comparison groups W|^e living in 
extended family situations, the evaluators^ took note of th^^ufnber of older and 
younger children in the- household, including siblings. In this instance the 

^comparisori group again exfeeded the treatment group In -family size: children 
in the treatment group had 1.06 older children in the hotisehold, while comparison 
group children had 1.57. The treatment group -children had .56 younger children 
in the household and comparison group children had .67 younger children in the 
household. Both treatment and comparison subjects were more likely to be second 
in birth order 'within their family than in any other position: for the treatment 
group the mean birth order position was 1.81, , for' the comparison group mean 

. birth order posi): ion was 1.90. 



Presentation of Data 



Developniental Profile ' ^ 

table 2 presents pre- and post-test scores for treatment and comparisfin 
subjects on the Alpern-Bpll Developmental Profile. In the table 'X' denotes 

a pre-test score and *Y' denotes the post-test score on the same scale. 
. • t 

Table 2. Mean Pre- and Post-Treatment Scores on Five Subscales of 
the Alpern-Boll Developmental Profile for Treatment and 
■ • Comparison Subjects i 



XPA 



YPA 



XSH 



YSH XSO YSO 



Treatment 



Comparison 



37.30 



33.81 



47.12 



42.48 



41.33 



38.76 



53,25 



50.19 



38.7,5 



37.33 



49.25 



44.57 



XAC 



YAC 



32.88 



29. 



44.38 



NOTE: All scores in nion^s 

- Physical Age X = Pre-Treatment Score 

SH - Self Help- Y - Po^t-Treatment Score. 

■SO - Social Age 
AC - Acafiemic Age 
CA - Communication Agg 



ai^36. 



76 



XCA 



YCA 



33.62 



32.67 



42.75 



38 . 38 
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The much-used- Intelligence qui>tient can be calculated from the ^ . . 
Alpern--BoIl, Academic Age by dividing the Academic Age score in mqnths by "the 
child's chronological' age in months. When thiis corjputation was made the pre-* 
test IQ for treatment children was 9*\.44 and the pre-test IQ for thfe cbmparj^scfn 
group was 86.52^ At. the time post-testing the 10 of the treatment group - 
was 106.00*and the IQ of the comparison group was 89. 8* 

,rhe scores on the Developmental Profile showed the same pattern: the 
-rcaatment group had a slightly hiVtier score at the time of pre-testing, and 
the treatment group nUintained or increased this efige at the time of post- 
testing. 



Diet History 

'•^^v^ The figures in Table 3 show the pre- to post-treatment change in 

diet history scores for treatment and comparison subjects. 

Table 3. Mean Diet History Scores, fpr Treatment and Comparison 
Subjects Before and After the Treatment Interval 





XDH ■ 


YDH 






Treatment 


58.00 


61. d 






Comparison 


62.19 


54.0C( 







100 



NOTE: Highest PosSib||5 Scor^! > 
X * Pre-treatnent Score 
Y « Post-treatment Score ^ 

In the case of the diet history scores the treatment group' began with 
a slli^htlv lower score- than the comparison group, but after treatment the 
positions were reversed: the comparison group actually obtained a lower score 
at post-testing while the score for the treatment grpup was higher. 
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OTT Winter vi e v . 

- ' The score s recorded in TabLa 4 indicate pre- and post-creatmen» 

differences between treatment and comparison groups on the five scale s<^ores 
and total score for the Observation of Teaching Task/Intervievf which was 
designed to assess parenting skills. With two exceptions the treatmentVroup 
^ad ^ke higher mean'score Initially. Fallowing the six "-^^^^^f ^-j^^^^ase 
period all mean differences favored th^ treatment group. Except in the case 
of the 'Behavior Jtanagement' spale the treatment group showed larger gains 
over the six month period than did the comparison group. ^ 

le 4. Mean Pre- and Post-Treatment Tot'^al Scores on OTT/Interview 

Scales and Total for Treatment and Comparison Subjects 



Treatment 


vopv v-Ptrw Yn«M YRHM XIIOL YUOL XTS VTS XORG 


YORG 


XTOT 


YTOT 


7.53 


8.S8 


10.88 


11.29 


9.71 


i^.24 


23.94 

^\ AC 


25.82 


14.24 
13.75 


16; 35 

^ j 

15.20 1 


67.31 
62.48 


74w94 
66.38 


Comparison 


|7.95 


8.25' 


10.55 


11. IP 


9.80- 


l^il5 













NOTE: Highest fossible Total Score-88 PEN - Provision for Child's Emotional 



X - Pre-treatment Score 
Y • Post-treatment Score 
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Needs 

BHM --Behavior Management 
UOL - U*se of Language 
TS - Teaching Style 

ORG - Organization of Child's Environment 
TOT - Total Scqre 
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Data Analyses 

Th^ analysis of covariance is a statn^sticai technique which may be used 
when it is not possible to establish iniaially that treatment and comparison 
groups are equivalent with respect to relevant variables ♦ In the Clinp study 

attempt was xixade to balance the treatment and comparison grpups wJth 
respect to chrofiological age and sex. Howeverj it was not possible^^o equate 
the two groups on other important variables such as physical or academic age, 
/ education of parents, number of siblings, etc. Therefore, multivariate 
' ^ analysis covariance (HANCOVA) was used in several instances to adjust post- 
treatment ^neans for pre-treatment differences in performance. The .05 level 
was chosen as the criterion for significance in all statistical tests performed- 

Developmental Profile ^ V. • 

When post-treatment means for the five scales of th^ Alpe^^Boll Develop- 
mental Prof ile^CDP"^ were' adjusted for initial differences between treatment 
and. comparison groups on the scales, the multivariate F was significant (F « 
3.47, df * 5, 26, p ^ .02), and the treatment group was found to have a higher* 
mean Academic Age (p -< .00) and a higher m&an Communication Age , (p .04) • 

Tablets. Univariate Analysfcsof Variance for Treatment Group 
Differences on Five Developmental Profile Scales. 



Variable 


Mean Square 


Univariate F 


£ 


*Y Physical Age 
Self-Help 

Y Social Age 

Y Academic Age 

Y Communication Age 


20.76 
11.26 
70.11 
240.12 
100.42 


.92 

.24 
2.08 

: 12.02 
4.80 


.34 
.62 
.16 
.00 
.04 


*Y=Post-tredtiaent score 




* .. 
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In order to dete^;rnine whether the pre-post differences on the Developmental 
Profile which favored^the treatment group were actually due to the treatment or 
to some differences between the groups on socio-economic variables, a regression 
analysis was performed with the five subtest scores of the DP as dependent 
variables and seven socio-economic variables as independent variab^s. This 
analysis showed that the DP scores could not be preciictied from the variables 
► of sex, income level, participation in the W-IC program, number of older ' * 
siblings, number of y^ounger siblings, Jhe education of the mother, or the 
presence of the father in th^ home (F - 1.22, df « 35, 108, p< .22). Taken^^ 
together, this group of demographic variables accounted for only 23 percent 
df the variance in the DP scores. - ' f 

Another regression analysis was employed to test the ijelationship between 
a second set of demographic variables and Developmental Prof ile scores. This 
time the dependent variables included sex, income level, WIC partic^ipation, 
age, mother's level of education, father presei^ or absent, number of older 
children in the household, number of younger children in the household, and 
birth order^. There was an association between the dependent and independent 
variables (F « 2.16, df « 45, 105, p ^ .00), and the demographic variables 
were shown to account for 36 percenfc of the variance in DP scores. The 
variable of age made the primary contribution to the predictive ability of 
the regression model. 
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Sev'urai regression analyses were perfonned* in an attempt to identify rt^e 
precise relationship between age and D]^ scores* WhtifCi age was used as the 
independent variable and gain scores, foj/the five DP^^cales constituted the 
dependent variables, age was sho\ini to nav€» no overall predictive, power for 
such scores either for the treatment group or for the conjparison group. When 
a MANCOVA was computed with treatment as^ the independent variable, the DP ' 
gain scores as dependent variables, and age as a covariate, there were 
differences between the tgreatment and comparison groups on the Physical Age 
scale. Apparently there was a relationship between chronological age and 
PhysicaL Age scores regardless of the 'treatment which was applied. 

/ A MANCOVA was performed to assess the dif f erenceif .^b^tween the Woreg of 
males Ijmd f em^^les on the Devglopmental Profile • In this aTKLl ^is j rreatment 
differences again were detected (F « 3.31, df - 5, 24, ^ ^ .02), but there 
were no ^ex differences (F - 2^24, df « 5, 24, p <i .08). There, was not a 
significant intehnttj-on Cf « .^2, df « 5, 24, p < .49^ between sex and treat- 

ent , i.e., the treatment- was not more effective with girls than with boys, 
or vice versa. 



Diet History • ^» * ^ 

When the post--t reatment mean diet history scores were adjusted for prfe- 
t reatment differences between tt^ Jtment and comparison groups, the treatment 
sroup was found td have a highep mean score (F « 4, 38, 1 df, p < .04) . 

Observation of Teaehjnp; Task/ Interview • • ^ 

Using an analysis of covariance design to adjust post*-treatm^t total 
score means on the Observation of Teaching Task and accompanying parent 
interview for pre-treatment dif f erences , the difference in means was found to 
favor the treatment group (F « 5.29, 1 df, p < .03). However, the MANCOVA 
involving scores for individual scales^ within this form (Provision foi* 
^Emotional Needs, Behavior Management, Use of Language, Teaching Style and>"' 
Organization of Environment) yielded a multivaisiate F which was not significant 
ts^ • 1.27, df - 5^ 26 p < ,30). Post-test means, on the Teaching Style scale 
sW^ed a difference which favored the treatment group (p < •03), but the . 
nonsignificant inu^*«^var iate F makes the importance of this difference question- 
able* 

Table 6. Univariate Analyses of Variance for Treatment Group 
Differences on OTT Scales. 

Variable Mean Square Univariate F £ 

*Y Provision for Child's Emotional Nepds . 2.71 ' ' . / 0 .41 

Y Behavior Management ,59 .11 • .74 

Y Use of Language 9;49 2*98 . .09 

Y Teaching Style 5^.38 5.49 ' .03 
j^H Organizatipn of Child's Environment ^ f .54 .09 .76 

*Y»Post-t:reatment score 

A regression analysis was performed with the five scale scores of the OTT/ 
Interview A^^ependent variables and seven socio-economic variables as \Lndependent 
variables* This analysis showed that there was no association between'- the five 
scale scores and the variables of sex» income level, participation in the WIG 
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programt mrab^r of older siblitigs, number of younger siblings, the education 
of tbft mother,^ pr the presence of the fathe^in the home (F -» l*3Pi df • 3^, 
108, p <^,15).^ This group of demographic variables accounted for jus^ 24 
percent of the variance in OTT/ Interview scores, 

A second regression analysis was performed to test th^ relationship 
between OJT/Interview scale scores and sex/ income level, WIC participation, 
-age, jnother's level of education, father present or absent, -iiun^er of older 
ch^ildren in the household, number of younger childr^en in the household, and 
birth order. Again there was no association (F « 1.45, df 45, "106, p ^ .06) 
between t-he five scale scores and the independent variables. ^ 

The GTT/Interview was found to have an acceptable degree of reliability. 
The riliability coefficieat (Cronbach a) indicating the degree of internal 
consistency for the total sgale during pre-treatment use was^ .92, and during 
post -treatment use .90. Thus the average of all coefficients of correlation 
between individual item ratings and tot?al ratings on this instrument was .90. 
or above. ^ 

•'Teaching Style" had the highest degree of. internal tronsistency of all 
the scales of the OTT (pre-treatment a * .86, post'-treatment a*" .80), Th^ ^ 
scale "Provision for Emotional Needs" also had an acceptable degree of 
reliability (pre-treatment a « .88, post-treatnent - . 74) . 

Internai consistency was somewhat questionable for the ^scales "Organiza- 
tion of the Child^s Environment" (pre-^treatment ol m J 69, .post-treatment a «• .72), 
'^'se of Language" (pre-treatmeAt a « .73, post-treatment a « .61), and "Behavior 
Management" (pr^-treatment cr < .65^ post-treatment cc » .59)V 



Variability in agreementv*etv^^^ raters using the OTT/Interv^' ew was 
noteworthy. • 



Table 7 shows pre- and post-treatment coe&ficients of correlation 
(or extent of agreement) between the two members of each of the three Evaluation 
leamsv^on scale totals and grand total of the OTT/Interyiew. 

^ Interprtftatiorvk of Data Analyses 

Developmental Profile , .V../;, 

The significant multivariate F obtained in the MAN.COVA 'Involving the five 
Developmental Profile (DP) post-test scores as dependent variables ^and pre-te'st 
scores; as covariates indicates that the CHDP intervention was successful in 
producing greater increases in those scores for the treattMent,. group. The 
specific scores which showed significant differences Jwete Ac^ademic Age (from 
which an IQ score may be derived) and Communication Aije^. Thus treatment was 
most effective in increasing cognitive skills^ \ 



Regression analyses which tested the effects of vari^^s .demographic 
variables on the post-test scores strengthened the conclusion that ^he CHDP 
"treatment" was the factor most responsible for the increases in treatment 
group scores. There was no association between scores on the DF scales and 
the variables of sex, income level, participation in the WIC program, number 
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Table ?• . Pre-* and Post-Treatment Cpef f ieients of Correlation Showing 
Inter-^Rater Agreen^rit for -the TVo Hembfrs of Three Teams on 
- Scale Totals and Grand Tot^I of the (^TT/ Interview 



^ Scale ' 
Provision for Child's Emotional Needs 
Behavior Management 

Use of Language « ^. 

Teaching Style 

\ ■ 
Organization of the Child's Environment 

TOTAL 

Provision for Child's Emotional Neftis 
Behavior Management 
Use of Language* 

, Teaching Style f 
Organization of the Child's Environxaent 
TOTAL . • 



Jeam 1 


' Teara 2 


Team 3 


Pre-treatment 


• 07^ 


. .98 


.93 


w56 




.64 


.86 

.'^^^ 


.84 


,97 


• 1.00 


.95^ 


.68 


\99 


.91 


9 

— ^ PosJ^treattnent 




' .96 


^ .39 
.8fr 


.61 • 


1.00 


.51 


LOT) 


*83 


.56 


s97 


, ' .73 


.97 


1.00 


.89 


.74 


,99 


.91 
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of oldeii'y siblH^gs, number of younger siblings, education of the mother, presence 
of fathei^ in the hose, number of o^^er children ir^^ the household, number of 
younger c|iildren in the househoid^f' Mor birth order*' 

Age was 'the only demographic variable found t-o have an effect on CP scores, 
and the only discernible effect of age was on Physical Age% scores. The data 
suggest that older children in the treatment group could be expected to make 
higher Physical ^\ge scores regardless of the treatment* 

* 

Diet History 

The ANCOVA which adjusted post-treatment mean diet history scores for 
pre-trQatma^nt differences among treatment^and conparison subjects showed that 
after the Cm>P irtterventipn the treatment children were eating* more nutritious 
meals than their peers in the comparison group* 

QTT/Interview - 

Total mean post-test scores on the "Observation of Teaching Task"/Interview 
instrument were higher for the treatment group than for the comparison group 
when adjusted for pre-treatment differences between tfhe two groups* Thisi^ 
suggests thiit the CHDP interveation was successful ip changing parent behavior 
and improving parent-child interaction, at least with respect to the kinds of. 
behavior specified fn this instrument. However, the fa«t that there were no 
differences between treatment and comparison groups on the individual scales 
'of the OTT/Interview (multivariate E| nonsignificant) suggests th^t .technical 
defects in this instrument may malce it of doubtful value in assessing parenting 
skills. 

The Teaching Style scale had the highest degree of internal dohsi>teticy 
of the five scales^ (pre-treatment gc » .88, post-treatment cx » •"7^- The 
MANdOVA also sugge^^ted that Teaching Style was the only scale which showed p^e- 
post differerices between the treatment group and the comparison group* Evalu- 
ation Teams 2 and 3 achieved an acceptable degre*» of aj^re^ment between raters 
on the Teaching Style scale. Thus Teaching Style : ppeirs to bfe the most 
reliable, and perhaps also the most valid, scale co^ntained in the OTT/ 
Interview. ' \ . 

^* 

The scale * Provision for Emotional Meeds* had an acceptable level of 
internal consistency (pre- a » .88, post- a « •74), but only one Evaluation 
Team achieved acceptable inter-rater reliability coefficients for pre-testing 
and post-testing. v 

Inter-rater agreement was highest for all Evaluation Teams on the scale 
^Organization of the Child's Environment', but internal consistency'was not 
acceptable (pre- *59,^ost-fl: « •72)* 

Since it is difficult to achieve significant mean differences between 
treatment and comparison groups using an unreliable instrument, and since over-* 
all reliability for some of the scales that make up the OTT/Interview "is doubt- 
ful, it is not possible to say whether the intervention really produced a 
difference between the parenting skills of mothers of treatment subjects 
parenting skills of comparison mothers* The intervention may indeed have/made 
a difference, but due to the unreliability of the instrument this cannot ^e 
said unequivocally* 
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Conclusions Based on Treatment-Comparison Croup Study . 

Mctisure3 of \?eveIo|fment 

Th6 CHDP intervention was apparently successful in increasing cognitive 
skills as measured by the Academic Age and Communication Age scales ^£ th6 
■ Alpern-Boll Devel^opnental Profile (DP)* However, after six ntonths of the CHDP 
intervention scores for treatment subjects on the Physical Age, Self-Help Age 
and Social Age sc|iles of the Developmental Profile were not significantly 
greater than scores of the* comparison group in these areas following the same 
six-month period, • The question could be asked, *'Did the intervention fail to 
have an effect on physical, , self-help, and social development, or was the 
failure to attain statistical significance in these areas due to technical , 
defects in the. instrument used to measure then?" 

The Manual which describes the Developmental Profile (1972) contains 
virtually no information on the instrument's reliability — nothing about internal 
consistenqy , no ^tem analyses, merely two investigations of scorer agreement 
admittedly carri«i out "with the pro-standardized version of the inventory" 
(p, 67). With rl\^rd to validity, the Manual states that correlation studies 
which might establish a relationship between scores on the Developmental Profile 
and "Scores on other instruments desip,ned to measure similar areas of development 
have been carried out 'only for the' Academic Age scale. (Apparently the 
correlation between Academic Age and the Binet Mental Age is approximately .84.), 
With such scanty information on the reliability and validity of most scales 
in the DevelopmenLal Profile there is reason to doubt« that its scores provide 

• an accurate measure of early^ development, except, perhaps, in the cognitive 
domain. Therefore, it is not possible to say, on the basis of scores obtained 
from the DP, that the CHDP was or was not successful in producing gains in ^ 
physical, self-help, and social development. Resolution of these questions 
must await ,the selection (or development) of more accurate measures of .early 
devc^lopment in these areas than the Developmental Profile currently pYovidea* 
If the CHDP staff believes it is impor,tant to promote development of its 

Clients in these non-cognitive areas, then -the staff, and its training group 

at the State level, should be actively engaged in thp research required to 
obtain such measures. 

yOietary Practices 

The diet history scores of children in the CHDP treatment group increased 
from 58 to 62 on a- scale of 100 during the six m* iths of intervent'ion, while 
the .scores ef children in the comparison group actually declined from 62 to 54. 
While the mean difference favoring the treatment group was statistically 
significant, the post--treatment mean score for that group was not good enoup,h 
to substantiate a claim that treatment group children were eating well-balanced 
meals after 6 months of interventton. 

> According to Parent Questionnaire responses, 76% of the parents of 
treatment subjects felt the CHDP program had Increased their knowledge- about 
foods needed for growth and maintenance of health. But only 41% said their 
famij.ies were eating metre of these nutritious foods. Project records shed 
ffttle light on the ijMqe of family dietary practices: only seven (41%) sets, 
of records contained |P>tations that improvement in family diet was needed. 
(More such notations clearly should have been*ma'de since the pre-intervention 
mean diet history score of jiist 58 was not due to seven very low scores and • 
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tea very high scores » but rather to a clustering of scores in the 50s and 
low 60s.) Just two records container narrative evidence that fanily dietary 
practices had improved during the treatment period. 

The CHDP intervention apparently had a positive impact on family dietary 
practices, but much more remains to be* done in this area before Project ' 
supervisors can feel confident that their clients --are eating well-balanced 
meals. .Evidence of intervention in, the area of nutrition is sketchy at best 
in Ptojecr*> records-- either home visitors and the supervisors are not providing 
families with much information on nutrition, or they are pre /iding it but not 
noting this in the records. Project supervisors should decide which of these 
sexp^anations best describes the actual situation and th^n take steps to 
increase either the amount o^fc|^utrition information shared with Project 
families, or The document a tidlFhJ^ this practice in Project records, or both. 

Parentlii^ Skills 

l^ile there are technical deficiencies in the Developmental Profile, 
there is at least some evidence that that instrument actually measures early 
development of cognitive skills. There seems to be no good evidence that 
parenting skills were acc\fV:ately measured by the- Observation of Teaching * 
Task and Interview form emp\pyGd by the evaluators. The 'Teaching Style' 
scale appeared to be the most^ reliable^ and perhaps the most valid, of the 
five scales that comprised the instrument. But even that scale contain^d^ 
some items that did^not correlate significantly with the total score. Ihe 
best set of itrems, That is» the set having the highest level of intema]| 
consistency, should bq identified;' home visitors should receive intensive 
training in the use of this set of items; then one or two items at a time 
should be added and tested in an attempt to build an even more reliable 
measure of parenting skills. 



EVALUATION OF THE MANAGEJENT COMFONEKT ^ 

• ^ The evaluators added an overall management objective to the seven general 
CHDP objeo^tives. In order to assess the ef f ectiveYiess of Project management 
additional records were reviewed, an opinionaire was employed to measure team 
member morale, and a community survey was conducted* 



Evidence from Project Record; 



Evidence from several sources indicates that . the CliDP ' is utilizing all 
availab^.e referral agencies in recruiting clients. Unfortunately, howev^, 
funding limitations do not permit the CHDP teams to serv^ all needy clierts. 
Each team member continually maintains a full case load, but there are more 
eli'gible families, than can be -served by the present staff. 

T\\e reputation of the Project and the recruiting procedures of the home 
visitors are sufficiently positive to assure that few families contacted about 
beginning the Project reject the offer of services. During 1978, when over 
800 families were served by Project staff each month, only 99 families refused 
Project services* 
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Few parent gr#ups have been conducted by the CHDP staffs- and several - 
Moutcmg of Information point to a need for additional parent groups as a means 
of decreasing the social isolation of Project families. ^ " | 

* 

Evideij^e frs^ the Opinionaire for Team Members • • 

The evaluatorSfc with the assis^tance ot the CHDP supervisory staff, adapted 
statements from the Purdue Teacher Opinionaire to form a 95-item instrument ^ ^ 
containing information in ten areas of team member morale. The Opinionaire I 
was administered to all 37 CHDP team members employed at the seven Preject ^sices 
in June 1978. Overall, team member morale was high: the mean of all responses 5 
was 3*08, a 'probably agree* response on a 4-point Likert scale (l-Disagree, 
2-Probably Disagree, 3«Probably Agree, 4-Agree). Even on the. factor with the 
lowest mean score (2.66), team members compiled a * probably agree' reirponsc. 
In Table 8 the ten Opinionaire factors are listed in order from the factor having 
the highest mean score (the most favorable response) to the factor having the 
lowest mean score. ^ . r , ^ 

Table S. Ten Factors from the Opinionaire for Team Members Ratfked in 
Order from Highest to Lowest Mean Score § 

Rank . Factor ' ♦ Mean 

1 Rapport Among Tear Members ' 3.46 

2 .Coosnunity Pressures 3.41 

3 Education, Social, and Health Issues 3.24 

4 ^ Satisfaction with Position , 3.17 

5 Community Support of Project 3.04 

6 Rapport with Supervisor and Supervisory Team 2.95 

7 Project Resources and Services 2,84 

8 Team Member Salary 2.79 

9 Team Member Stai:us 2.69 
10 Team Member Workload 2,66 

Home educators^in the Project exhibited the, most positive attitudes on 
Opinionaire .items (X « 3*25), followed by the nurses (x ■ 3.113), the social 
workers (x - 3.111), and the secretaries (X ■2.76). 

^ Xhe fact that 'Rapport Ampng Team Membera/ was the factor with the highest 
mean score on the Opinionaire suggests t^t CHDP team members were quite 
satisfied with their use of a team approach to home-based early intervention. 

In general, the teaxu members did not feel that community pressures kept 
them froni^oing their best in their jobs, imposed unreasonable persc^nal 
standards, or restricted their participation in nonprofessional activities. 

Uith regard to the mo^t negative factor, 'Team Member Workload % team 
aembers felt that required reports and papper'wrk took so much of their tis^ 
that their clients were placed at a disadvantage. The item in the 'Team 
Membuf. Status' factor which produced the most negative response (X 2*17, a 
'probably disagree' response) was "Hy position in this Project affords me the 
«ecurlty I want in an occupation.^' 
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¥ Evidence fro© Cdmunity Survey 

i ■ 

A Con?-^nity Survey instrument was designed by the evaluators to assess 
the attitudes toward the CHDP of a stratified random sample of citizens in the 
aix counti42s wherii the Project had bijen in operation for .at least a y^ar. 
Responses were obtained from 176 citizens, 42 percent af the 422 persons to 
whom the Survcir was niaileJ# 

Sixty-one percent of the respondents said they had heard of t^e CHDP» aud 

55 percent of these had had first-hand experience with the staff and services 

provided. Eighty-three percent of the respondents with personal knowledge of 
the Project rated its services, as good (53%) to excellent (30%) • 

Project staff and connnuntty agencies such as the health, welfare or mental 
health department were the roost frequently mentioned sources of information, 
about the CliDP, . 

Eighty-one percent of all respondents felt ther\i yas a need in their 
comnunity for the types of services offered by the CHDP, Three-quarters of 
the respondents expressed willingness to have their tax dollars spent on such 
a Project. But only 23 percent felt that at least 75 percent of those eligible 
for the Prefect were actually being served by it. Persons who knew soiiie thing 
about the CHDP were more, likely to expr ess favorable attitudes about its 
sei-vices and to favor support for it th^n were thosif who had never heard of 
the Project, 

CONCLUSIONS AND RECOIlMErroATIONS ' • ' 



Overall Conclusions 



Within the limitations of time (all data to be obtained within nine mon;:hs) 
and money imposed on this evaluation of the Child Health and Development Project, 
the overall evaluation objective of providing evidence of short-term effect'^ttp- ^ 
ness of the Project in meeting its seven stated goals was realized. This i^as 
accomplished only through the use of multiple data sources because no one 
sourc<!K'-Project: Vecords , the parenting skills assessments currently used by 
home visitors, treatment-comparison group study, or the measure of parent .& 
opinion — was found to possess sufficient consistency, sufficient reliability, ^ 
to make a strong case for Project effectiveness when considered by itself. -n/^ 

' Sponsors of the CHDP evaluation were principally interested in obtaining 
indications of the effectiveness of their particular home-based team approach / " 
to early childhood intervention. In a general way, these indications were 
provided by the evaluators. Unfortunately the time allotted did not permit 
this evaluation to contribute significantly to solution of the problem which 
current literature suggests is of most concern to early childhood specialists, 
namely, which combination of intervention strategies is most efficient in 
assisting each particular client group. A study which limits th^ data-gathering 
phase to nine months does not .perr<it the sophistication of design that would be 
needed to tease out information about the effectiveness of par-ticular strategies 
with particular client types. 
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/Having acknowledged these liptita^ions, *the evaluators' general .tecommen- 
dfttiona-l^r future action on the part of CHDP management include: 

1) working to improve the reliability of the data-gathering sources 
r currently being used by Project *staff , 

2) adding a very limited number of new data-gathering Instruments, and 

3) undertaking a longer term (cont%iuous, if possible) external evaluation 
that would permit the use of case studies and*collection of ^longitudinal 
dijta to provide evidence regarding the effect 'of, certain intervention 
strategies with part-.ljf ar types of clients. 

Recommendations Based on Review of Project Records - ' ' 

The evaluators base the following recrmmendations on their review of Project 
records. 

(1) Project 'records should include more information on (a) family nutrition^ 
(b) nutritional information supplied to\^ch family by Project staff, an4 (c) any 
improvement in family diet whijch may : have occurred as a result of this intervention 

In order to provide a more objective Measure of, iiuprovement ;in family . 
dietary practices than isx:urrently available, periodic use of the diet history 
procedure 'employed in the evaluation should occux with each client , or at lea^t 
with a sample of clients. - Currently there is no way to tell how far the 
Iriteryention program is* capable of moving its families along the c^tiriuum from 
poor to good nutrition as evidenced in children's dietSt 

(2) Fewer than five percent of the records reviewed by the evaluators 
contained evidence of client delays on the Denver Developmental Screen-ing Test. 
The Denvei^ may be tqo gross a measure to provide the quality of developmental 
assessment needed to meet the goals of the CHDP. Certainly this ins^ rum4?.n^t 
has minimal value as a tool for r'esearch or evaluation because it does not 
yield quantitative data for approximately 95 percent of the CHDP client popula- 
tion. ^ , / • 

The Denver is not the on' developmental screening device which^ parapro- 
fessionals can be trained to use. Serious consi;3eration should b'3 given to 
subist'itution' for the Denver, at least periodically (i.e., altemace the Denver 
with another instrument for all clients), a measure which could provide' home 
visitors with more specific information about the development ,o£ their clients. 
As a first step in this direction, the Academic Age and Communication- Ag6 scales 
of the Alpern-Boll Developmental Profile might l?e tr^ed. The ^valuators f<3aad 
rauch intere^it among home visitors in hearing how their clients performed on the 
Developmental Profile when this was administered in the course of the treatSent- 
comparison gxroup study. , ^ , 

Recommendations Based on Study of Parent Opinion Concerning the CHDP 

The evaluators strongly reconmend that CHDP staff add to ^eir data-gathering 
instruments a periodic measure of parent opinion such as the Parent Questionnaire 
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developed for the evaluat;ion* 'Patent opinion should be solicited soon after 
the initiation of Project services as part of an effort to detect incipient 

problems in the relationship with a new client family before these problems 
cause the family to reject further services. ^ 

During the first thr^e or four months of Project services su^3one other 
than the assigned home visitor (another visitor from the same teani^ the Project ' 
secrj^tary durinj;^ a clinic visit , or a supervisor duriijg a home visit) should 
interview the parent to determine: 

1) how the client family is responding to the home visitor and her/his 
method of delivering services, and 

, 2) what asppct(s) of Project services the family finds most inconvenient, 
disruptive, or objectionable. 

Later in the period of service to a given family, a measure of parent 
opinion could add information which is not currently well documented in Project 
records concerning: 

1) the extent to which parents 

a) become involved in hone visits , 

b) learn to teach the child the lesson suggested by the home visitor, 

c) follow through with the teaching after the visitor leaves, and 

d) actually improve the quality of their interactions with their 
children as a result of Project intervent ion, 

2) the extent to which Project services decrease the social isolation 
of client families- 

Fewer than half of the parents interviewed during the evaluation said they 
knew "many of the- other children and parents' in the Project. There seemed 
to he some interest in parent discussion groups and/or field trips. As a 
means of promoting social integration on the part of Project families the 
K^valuators recom?iend that parents who vclunteer^to do so be brought together 
^ small groups on a regu4^r basis to discuss common concerns. A play group 
for Project chi idren- should be conducted simultaneously with the jbarent meetings. 

Recommendations Based on the Opinionaire for Team Members 



In general. Che morale among team members at the ' seven CHDP sites w^as quite 
good. The fact that 'Rapport Among Team Members' was the Opinionaire factor with 
the highest mean rating indicates that Project staff at each site respected each 
other, enjoyed their opportunity to work as a team, and supported the tea^ 
concept on which the CHDP is based. 

However, there seems to be room for improvement in team members' satisfaction 
^ith their positions. A substantial number said they experienced **stress and 
strain*' in their work, that they did not feel they could make their 'greatest 
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contribution i:o society' in their position, and that they would' change jobs if 
they could earn as much money in 'another^ occupation. The supervisory staff, 
through praise for individuals and inforniation provided in groups, could increase 
team members' feelings of self-worth, accomplishment, and occupational satisfaction. 

The use of ethical procedures, not merely pqfitlcal patronage, must be 
employed in thi* appointment and reappointment of team members. Politically 
dictated appointments of persons without the training, experience, anc* compe^ 
tence required of ^CHDP team member seem to have caused as mucTV frustration 
and jo^ dissatisfaction among staff members as any other single factor > ^ 

Community awareness and support must be solicited for the Project in those 
counties where the services have most recently been implemented. 

Most team memb.ers found the time spent In' record keeping excessive. Members 
might be encouraged to dictate their reports as a time-saving mechanism. 



Recommendations Based on the Community Survey 



Citizens in five counties served by the CHDP who responded to the Community 
Survey expressed favorable attitudes toward the need for services such as those 
the Project provided and toward the idea of having tax dollars spent on the 
Project. Fiowever, a majority of the citizens responded negatively when asked 
if they thought 75 percent of those eligible for the Project were being served 
by it. Survey results suggest 'the following recoirmiendat ions : 

1) The CHDP, staff should continue to utilize team members and Health/ 
welfare agencies as sourtJfes for informing the public about the services 
provided by the CHDP. These appeared to be the most effective informa- 
tional sources; however, other sources, especially newspapers and radio, 
should also be used to reach a larger pfopx>rti^ of the community. 

2) The staff at each Project site should publicize, if -possible, estimates 
of the number of clients they serve in comparison with the nutftber in 
their area who need the services. 



3) Attempts should be made to establish better coordination, and less 
duplication of services, with other agencies performing functions 
similar to those of the CHDP. In instances where the ^duplication 
of services is a perceived and not an actual duplication, this 
distinction should be made claar to the community. A series of 
articles in the local newspaper describing the functions of the 
agencies and highlighting differences could be a means of achieving 
this 6no. 

4) Take advantage of the support for the Project which was expressed by 
— c^ixen-Yespdndents in efforts to: 

• a) increase the number of n members so that more of the children 

and families who need tl services could be included in the program. 
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lecrease the heavy _workload of team members by hiring more 
^ qualified persons' regardless of political connections. 
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c) serve oth^r children in the families currently involved, or 
families above the incosie restrictions vho.coulti benefit rroa 
the services. ^ • • , 
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